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(54) Abstract Title 

Computation time reduction for three dimensional displays 

(57) A reconfigure ble, three-dimensional display wherein knowledge of the viewer's eyes is used to enable 
the effective exit pupil(s) of the display system to be optimised. The system utilises this knowledge to Identify 
contributing regions within the display that contribute light to the viewer. Priority Is given to calculating and 
displaying the part of the display corresponding to the contributing region, thereby allowing the system 
computation requirements to be minimised. Further computation savings are achievable by recognising that 
only light travelling in a limited range of angles need be considered. 
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Computation time reduction for three-dimensional displays j 

The present invention relates to reconfigurable three-dimensional displays and 
particularly to displays utilising Computer Generated Holograms (CGH). The invention 
5 provides a means of minimising the computation time required to generate a 
Computer Generated Hologram (CGH). 

There is significant interest in producing reconfigurable three-dimensional displays for 
use in applications such as interactive design, medical imaging and scientific 

10 visualisation. For some applications it is desirable that the display can be viewed 
without any special glasses and by multiple viewers and that the image contains as 
many of the three-dimensional depth cues as possible. Display methods with these 
attributes include Computer Generated Holograms (CGH) and auto-stereo systems 
incorporating lenticular lens sheets or microlens arrays. These methods typically 
. 15 make use of a two-dimensional pixelated display device (transmissive or reflective) 
such as a liquid crystal display in which the amplitude and/or phase of each pixe! 
(picture element) is used to encode the required pixel value. The pixel values are 
calculated such that when the device is appropriately illuminated and suitable replay 
optics are used, a three-dimensional image of a simulated object is obtained. , 

20 Alternatively, the liquid crystal display may be replaced by a non-pixelated spatial light 

modulator such as an acousto-optic modulator. In this configuration small regions | 

I 

within the spatial light modulator (SLM) perform the same function as the individual 

i 

pixels in the liquid crystal display. j 

25 Despite advances in computer technology and optical modulation techniques, the 
generation of near real-time, reconfigurable, high quality, three-dimensional images 
continues to present major technical challenges. For example, reconfigurable display 
devices for three-dimensional images remain complex and in the case of CGHs 
computationally intensive, placing heavy processing demands on underlying 

30 computer systems. 

For a display system based on a CGH, the complexity of the display device, in terms 

of the number of constituent picture elements or pixels required, is determined both \ 

by the required image size and angle of view (the angle over which the image can be 
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seen by a viewer). Particularly for multi-viewer systems, which tend to need large 
viewing angles, this results in a need for large numbers of pixels (e.g. 1 0 12 pixels for a 
workstation application) and hence very complex display devices. In terms of 
displaying Computer Generated Holograms, the computation of the pixel values for 
5 such a large number of pixels in real-time or even at an interactive rate is also a major 
challenge, as is the method of transferring data to the display. 

In parallel with the aforementioned advances in computer technology, several 
techniques have been developed for reducing the full system requirements of the 
10 display system in an attempt to produce a viable reconfigurable three-dimensional 
display. 

One conventional technique for reducing the requirements of the display system is to 
incorporate moveable exit pupil(s) within the system. The exit pupil is a region 
15 through which all light rays that can be traced all the way through an optical system 
must pass and is a familiar concept to the skilled person working in the field of optics. 
In a conventional optical system the exit pupil would typically be a physical aperture 
or an image of a physical aperture. 

20 A. Schwartze, "Head tracking stereoscopic display 7 ', IEEE International Display 

Research Conference, 1985 describes a stereoscopic display system which presents 
two two-dimensional perspectives to the viewer. The system uses two CRT projection 
modules in conjunction with a simple head position sensor and electromechantcally 
controlled moveable exit pupils. The viewer's head is tracked to ensure the exit pupil 

25 for the appropriate view is located over the correct eye. The system accommodates 
lateral movements made by the observer and allows the user to view a stereoscopic 
presentation without using special glasses. 

Since the system senses the lateral position of the observer relative to the display, it 
30 is possible to generate and display different stereoscopic views according to observer 
position, thus producing the look-around effect of a real object. The full system 
requirements are therefore reduced since the system is not required to 
simultaneously produce images for all possible viewing angles, only the images which . 
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correspond to the observer's particular lateral position. Thus the computational 
■ requirement for the system is also reduced. 

Fukaya et. al. ["Eye-position tracking type electro-holographic display using liquid 
5 crystal devices", N. Fukaya, T. Honda, K. Maeno and K. Sato, Proceedings of EOS 
Topical meeting on Diffractive Optics, 1997] describe an electro-holographic display 
system incorporating eye-position tracking. 

In the system proposed by F.ukaya et. aL, two small LCDs display computer 
10 generated holograms. Being small, the three-dimensional image from each liquid 
crystal display has only a small exit pupil (small field-of-view). The LCDs are 
positioned relative to each other such that their exit pupils coincide with each of the 
observer's eyes. A scanning mirror is used to ensure the exit pupils follow the 
observer's eyes during lateral movements. The computed CGH contains far more 
15 pixels than the display modulator can support, and essentially only the part of this 
data required by the observer is put on the modulator, dictated by the observer's head 
position. By displaying only part of CGH, the full system requirements are again 
reduced. 

20 The computational load on the underlying processing system for both of these 
displays is relatively low, however, both techniques suffer from several inherent 
disadvantages. 

Firstly, in both of the aforementioned systems the exit pupil(s) is scanned by - 
25 mechanical means to follow the viewer's position. The complexity of the display 

system is thereby increased over a conventional CRT or LCD display. Furthermore, a 
disquieting time lag may be introduced due to the tracking control system. 

Secondly, the shape and size of the exit pupil(s) for the above systems are limited 
30 and only the lateral positions of the exit pupif(s) can be controlled. Furthermore, the 
displays, as described, are restricted to single observers and are incapable of 



.4 - 



producing an enlarged exit pupil (field-of-view) to cater for multiple viewers or to 
reduce any lag in image appearance when the viewer makes rapid head movements. 

These two techniques essentially use a low pixel count display devices (with relatively 
5 low computational requirements) and increase the field of view through mechanical 
scanning. The present invention relates to using a high pixel count display with a 
large field of view that doesn't suffer from the above disadvantages. Such displays 
would normally have high computational requirements. It is an object of the present 
invention to enable these requirements to be significantly reduced. 

10 

In order to clarify the significance of the exit pupii in such 3D displays the following 
analogy is provided. Consider viewing an object a short distance behind a window in 
an opaque screen. The range of positions from which the object can be seen (e.g. to 
look around its sides) is limited by the size of the window. In the display system under 
15 consideration the exit pupil defines the 'window 1 in this analogy and the image 
provided by the display is the 'object'. An interpretation of the two previously 
described display systems is that the "window 1 , or exit pupil, is moved to always be in 
line with the observer and the 'object', or image. 

20 For a given observer position, the 'window' can be smaller (without clipping the 
observer's view of the object) the closer it is to the observer. The present invention 
can be considered equivalent to enabling the display to produce an image that can 
on |y be seen through such a small, adaptable 'window 1 . Just as a 'large window' 
(determined by the optics in the system) through which an image can be seen from a 

25 wide range of viewing positions is properly termed the 'exit pupil', we introduce the 
t erm 'effective exit pupil' to represent the additional small, adaptable 'window'. The 
presen t invention enables a small effective exit pupil to be positioned near to the 
viewer(s). The effective exit pupil is 'moved' to follow viewer(s) such that the image 
can be seen from the same range of viewing positions that the exit pupil would allow. 

30 This is achieved by appropriate calculation of the display pixel values. The viewers 
eye positions need to be obtained using some form of head tracking device. 

It will be shown that the computation time required to calculate the pixel values in the 
display is reduced as the size of the above effective exit pupil is reduced. 

35 
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Unlike the movable exit pupils of the previous examples, the positioning of the 
effective exit pupil(s) requires no moving parts in the system of the present invention, 
potentially reducing costs and increasing reliability. Further, the system of the present 
invention allows the effective exit pupil(s) to be of arbitrary shape and arbitrarily 
5 positioned in ail three dimensions, improving ease of use. Multiple viewers are also 
catered for with the present system. 

Additionally, the present invention allows the effective exit pupil(s) or fieid-of-view of 
the system to be enlarged when no changes occur in the image. This has the 
10 potential to allow the elimination of lag in image appearance that .may occur when the 
user makes rapid head movements. 
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According to the present invention apparatus for producing a three-dimensional 
image comprises; 

a display means capable of producing a three dimensional image which is capable of 
5 being viewed from a range of viewing positions, 

a monitoring means for obtaining information about the at least one observer, 

and Control means responsive to the monitoring means for controlling the display 
10 means, 

wherein the display means comprises a plurality of addressable sub-regions 
controlled by the control means such that priority is given to producing a complete 
image for the at least one determined viewing position. 

15 

The apparatus provides a viable display by giving priority to only those parts of the 
image that may be seen by the at least one observer at the at least one determined 
viewing position. This enables a reduction in the time required to compute the pixel 
values in the display means thus allowing the image to be updated at a higher 
20 frequency. Since no moving parts are introduced, the apparatus remains cost- 
effective and reliability is enhanced. 

The eye positions and pupil sizes of the viewer's eyes are required by the control 
means for the purpose of identifying the contributing regions in the display means. 
25 The eye positions should be obtained by the monitoring means. The pupil sizes may 
be obtained by the monitoring means, or may be assumed to be a typical value such 
as 4mm diameter. 

Preferably the viewing positions of two or more observers may be determined and 
30 priority given to producing a complete image for each of the determined viewing 
positions. Multiple observers are therefore catered for by the present apparatus. 

In a preferred embodiment the control means identifies at least one contributing 
region, comprising addressable sub-regions of the display means, that contributes to 
35 the image formed for the at least one viewing position and gives priority to calculating 
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pixel values of the display means for said at least one contributing region. Parts of the 
image seen by the observer may be generated by separate areas within the 
contributing region, whilst separate contributing regions within the display-means may 
be envisaged for multiple viewers. 

5 

In a further preferred embodiment the control means gives priority to calculating pixel 
values for each of the sub-regions of the display means that comprise substantially 
the centre of the at least one said contributing region. This is advantageous in that the 
image appears to be built up from its centre. 

10 

In another embodiment the apparatus further comprises means for determining the 
position of ocular fixation within the display means of the at least one observer. In this 
embodiment the control means gives priority to calculating pixel values for each of the 
sub-regions of the display means that contribute substantially to the image at the 
1 5 position of ocular fixation of the at least one observer. 

For the purposes of this specification, the position of ocular fixation within the display 
means shall be defined as the observer's point of fixation on the image. The 
technique of monitoring an observer's point of fixation on an image is commonly 
20 known as gaze-tracking and is equivalent to, detecting the position of the fovea of the 
observers eyes. The information relating to the observer's point of fixation on the 
image is used advantageously to cause the image to be built up from the point of 
interest. 

25 In a further preferred embodiment the control means gives priority to calculating pixel 
values for each of the sub-regions of the display means that correspond substantially 
to parts of the image that are changing. This approach increases the rate of 
interaction between an observer and the image being displayed. Usability of the 
apparatus is generally enhanced by according priority to parts of the image that are 

30 changing. 

In another embodiment the control means determines the range of angles that sub- 
regions of the display means must direct light into to contribute to the image formed 
for the at least one viewing position and the pixel values of the display means are 
35 calculated such that priority is given to directing light into said range of angles. 
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In a further preferred embodiment the control means controls the display means such 
that the effective exit pupil of the apparatus is optimised for the at least one viewer. 

5 The effective exit pupil of the apparatus is a region through which all the light rays 
considered in the calculation of the pixel values will pass, The apparatus capitalises 
on the fact that no image degradation will be perceived provided the observer's eye 
pupils are located within the effective exit pupil of the display apparatus. 

10 Advantageously the time required to calculate and display the image may be 

minimised by optimising the effective exit pupil of the apparatus to coincide with the 
pupils of the observer's eyes. The apparatus allows the effective exit pupil to be of 
arbitrary shape and size and to be arbitrarily positioned in all three-dimensions. 
Hence, the apparatus exhibits a high degree of flexibility, allowing the shape, size and 

15 position of the effective exit pupil be adjusted. 

The effective exit pupil over which the complete image is viewable may be enlarged 
during periods when the image is substantially unchanging. This allows the observer 
to make rapid head movements without perceiving any lag in image replay. 

20 

The display means may comprise a spatial light modulator (SLM) means and the 
control means may be used to calculate the modulation required in the sub-regions of 
the spatial light modulator means. 

25 In a further preferred embodiment the monitoring means collects information relating 
t 0 the eyes of the at least one observer and the control means uses said information 
to adapt the effective exit pupil of the apparatus to match the eyes of the at least one 
observer 

30 In a particular embodiment the addressable sub-regions of the display means display 
a computer generated hologram. 

According to a second aspect of the present invention, a method of minimising the 
time required to display a reconfigurable three-dimensional image using 
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a display means comprising a plurality of addressable sub-regions, capable of 
producing a three dimensional image which is capable of being viewed from a range 
of viewing positions, 

5 a monitoring means for determining the viewing position of at least one observer, 

and control means responsive to the monitoring means for controlling the display 
means, 

10 comprises the steps of determining the viewing position of the at least one observer 
and prioritising the control of the addressable sub-regions within the display means to 
produce a complete image for the at least one determined viewing position. 

Preferably the viewing positions of two or more observers may be determined and the 
15 control of the addressable sub-regions within the display means prioritised to produce 
a complete image for the two or more determined viewing positions. 

In a preferred embodiment at least one contributing region is identified, comprising 
addressable sub-regions of the display means, that contributes to the image formed 
20 for the at least one viewing position and priority is given to calculating pixel values for 
the sub-regions within the display means that comprise substantially the at least one 
said contributing region. 

in a further preferred embodiment priority is given to calculating pixel values for each 
25 of the sub-regions of the display means that comprise substantially the centre of the 
at least one said contributing region. 

In another embodiment the method further comprises the steps of determining the 
position of ocular fixation within the display means of the at least one observer and 
30 giving priority to calculating pixel values for each of the sub-regions of the display 
means that contribute substantially to the image at the position of ocular fixation of 
the at least one observer. 
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In a further embodiment priority is given to calculating pixel values for each of the 
sub-regions of the display means that correspond substantially to parts of the image 
that are changing. 

5 In a another embodiment the method further comprises the steps of determining the 
range of angles that sub-regions of the display means must direct light into to 
contribute substantially to the image formed for the at least one viewing position and 
calculating the pixel values of the display means such that priority is given to directing 
light into substantially said range of angles. 

10 

in a another embodiment the method further comprises the step of controlling the 
display means such that the effective exit pupil of the apparatus is optimised for the at 
least one viewer. 

1 5 Preferably the step of enlarging the effective exit pupil over which the complete image 
is viewable may be incorporated during periods when the image is substantially 
unchanging. 

In one embodiment the display means comprises a spatial light modulator (SLM) 
20 means and the control means calculates the modulation required in the sub-regions 
of the spatial light modulator means. 

In a further preferred embodiment the monitoring means collects information relating 
to the eyes of the at least one observer and the control means uses said information 
25 to adapt the effective exit pupil of the apparatus to match the eyes of the at least one 
observer. 

In a particular embodiment the addressable sub-regions of the display means display 
a computer generated hologram, 
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The invention will now be described, by example only, with reference to the 
accompanying drawings in which; 

Figure 1 shows a schematic representation of a reconfigurable three-dimensional 
5 display system illustrating how only a small region of the display contributes light to 
the three-dimensional image that reaches the viewer's eyes. 

Figure 2 illustrates a schematic cross-section of a CGH display showing how ray 
tracing may be used to. determine the limited range of angles that each pixel in the 
10 CGH contributes light into that reaches the viewer's eyes. 



Figure 3 illustrates a schematic cross-section of a CGH display showing how 
collimated beams arising from the CGH give rise to points in the focal plane of the 
replay optics. 
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Conventional autostereoscopic and holographic three-dimensional displays contain 
far more information than a single viewer requires because the display simultaneously 
provides views for every potential viewing position, whether a viewer is there or not. 
Such displays have very large numbers of pixels, placing significant demands on the 
5 computation system used to calculate their values. 

The full system requirements for a such a reconfigurable three-dimensional display 
may therefore be reduced by calculating only the pixel values in the display device 
required to provide a three-dimensional image to a particular viewer, by making use 
10 of knowledge of the viewer's eye positions. This knowledge can be obtained using 
head/eye tracking systems that have previously been demonstrated. 

The present invention uses the knowledge of the viewer's eye positions to enable an 
effective exit pupil(s) of the display system to be optimised. The system 

15 simultaneously controls the shape, size and position of the effective exit pupil(s) of 
the display so as to coincide with the viewer's eye pupils. However, unlike some 
display systems which use electromechanical means to move an exit pupil to follow 
the viewer's eyes, the present invention relies purely on calculating the appropriate 
pixel transmission values in the display device to control the effective exit pupil of the 

20 system. 

No moving parts are introduced into the system, providing a cost effective solution 
and maintaining reliability. Moreover, since the effective exit pupil of the system is 
•moveable' by recomputing the display pixel values, there is no mechanical inertia in 
25 the display system to overcome. Accordingly, the system enables the effective exit 
pupil of the display to be rapidly repositioned both laterally and vertically in sympathy 
with the movements of the viewer. 

The display system exhibits a high degree of flexibility and may be adapted in real 
30 time to cater for multiple concurrent viewers by altering the shape, size and position 
of the effective exit pupil(s) of the system. 

Although the concept of controlling the effective exit pupil(s) of the system provides a 
concise way of explaining the present invention, the means by which the invention 
35 could be practically implemented would involve identifying contributing regions in the 
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display and the angles into which those regions need to contribute light. Hence the 
following discussion describes the invention from this perspective. 

The present invention utilises the fact that for a given viewer location, only a small 
5 region of the display contributes light to the image seen, known as 'the contributing 
region'. Calculation and population of the pixels within this region alone will provide 
the viewer with a three-dimensional image of the same quality as if all of the pixels 
were populated. To take account of the viewer's two eyes, or the additional eyes of 
multiple viewers, multiple 'contributing regions' could be utilised. 

10 

For the purpose of the of the following discussion the display shall be described in 
terms of Computer Generated Hologram (CGH) based systems although the principle 
is also applicable to other display systems. Furthermore, descriptions of display 
devices in terms of two-dimensional pixelated liquid crystal displays (transmissive or 
15 reflective) are illustrative and are not meant to be limiting. For example, a liquid 

crystal display may be replaced by a non-pixelated spatial light modulator such as an 
acousto-optic modulator. In this configuration small regions within the spatial light 
modulator (SLM) perform the same function as the individual pixels in the liquid 
crystal display. 

20 

For clarity, the following embodiments have been described in terms of a single 
viewer, although in practice the technique is applicable to three-dimensional displays 
with multiple viewers. 

25 Referring to Figure 1 , light passes through the CGH (1 ) and the replay optics (2) to 
form the three-dimensional image (3). Only a small proportion of this light will pass 
through the viewer's eye pupils (4), determined by the eye monitoring means (9), This 
light comes from the contributing region (5) and priority would be given within the 
controlling means (8) to calculating these pixels within the contributing region first. 

30 

The monitoring means (9) monitors the position of the viewer with respect to the CGH 
(1) and provides position data (for example the co-ordinates of the viewer in x, y and 
z axes) to the control means (8). The monitoring means (9) may also be used to 
obtain supplementary information regarding the eye positions and pupil sizes of the 
35 viewer's eyes. Furthermore, the viewer's point of fixation on the image produced by 
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the CGH (1) may also be determined by the monitoring means (9). This is equivalent 
to detecting the position of the fovea of the viewer's eyes. For the purposes of this 
specification the viewer's point of fixation shall also be referred to as the point of 
ocular fixation. 

5 

The above mentioned supplementary information is communicated to the control 
means (8) and is used by the control means (8) to determine the optimum 
contributing region. 

10 The control means (8) utilises the position data from the monitoring means (9) in 
conjunction with parameters relating to the display system (for example the size and 
configuration of the display element and optical components within the system) to 
calculate pixel values for the CGH (1). The control means (8) may include computing 
means to calculate the pixel values for the CGH (1). 

15 

The pixel values calculated by the control means (8) govern the amplitude and / or 
phase of each pixel within the CGH (1) such that when the CGH (1) is appropriately 
illuminated, a three-dimensional image (3) is produced by the relay optics (2). 

20 The computational requirement for the above system is reduced since only the pixels 
within the contributing region need to be calculated in order to present an image to 
the viewer. However, the image quality remains the same as if all of the pixels in the 
three-dimensional display were populated. Since the number of pixels within the 
contributing region is less than the number of pixels in the full display, the time 

25 required to calculate and display the image is correspondingly reduced. 



The above computational savings may be offset against other system parameters to 
allow other system functions to be improved; for example enabling the displayed 
30 image to be updated at a faster rate, thereby enhancing interaction between the 
viewer and the display system. 

Calculation of the pixel values within the contributing region (5) can be further 
prioritised such that the most important pixels within the contributing region (5) are 
35 calculated first. This will reduce the time taken to present the viewer with an 
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acceptable image. Two approaches are proposed to identify the pixels of most 
importance. 

Firstly, the pixels in the centre (6) of the contributing region (5) may be calculated 
5 first. This will cause the image to be built up from the centre (6) of the contributing 
region. 

Alternatively, in addition to knowledge of the viewer's eye positions, the viewer's point 
of ocular fixation on the image may also be measured. This is commonly known as 
1 0 gaze tracking and is equivalent to detecting the position of the fovea of the viewer's 
eyes. Priority may therefore be given to calculating the pixels that correspond to the 
viewer's point of fixation on the image (7). This will cause the image to be built up 
from the point of interest (7) within the contributing region (5). 

15 It is envisaged that calculation of pixels outside of the contributing region will be 

carried out when the image is unchanging, effectively 'filling out' the range of potential 
viewing positions and thus allowing rapid head or viewer motion with no lag in image 
appearance. 

20 A second level of computational saving is also proposed, which will still provide the 
viewer with a three-dimensional image of the same quality as if all of the pixels were 
populated. This is achieved by considering the limited range of angles that pixels 
within the contributing regions need to direct light into. Figure 2 shows how these 
restricted angular ranges may be identified by tracing rays from the CGH, through the 

25 replay optics and three-dimensional image and finally through the pupils of the 
viewer's eyes. 

Figure 2 shows a cross-section of a schematic of a CGH based display system, Light 
passes through the CGH (20), the replay optics (21) and forms the three-dimensional 

30 image around the focal plane (22). The three-dimensional image will typically be 

contained within a diamond shaped (polyhedral in three-dimensions) volume (23). An 
eye with a pupil is shown (24). Only light arising from the contributing region (25) 
reaches the eye pupil. The extremities of the contributing region are defined by the 
intersections of the light rays (26) that pass through the extremities of the image and 

35 the eye pupil. It can be seen that only a limited angular cone of light (28) arising from 
a single pixel (27) in the CGH reaches the eye pupil. Another feature of CGH based 
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displays is the viewing region, the bounds of which are shown by dashed lines (29). 
This is the region in which the eye needs to be located in order to see the whole 
image. 

5 To illustrate how the method may be used to achieve computational savings, consider 
the design of a CGH using the "Coherent Ray Trace' method. 

The desired three-dimensional object would be defined mathematically, perhaps with 
computer aided design software. Its surface would be uniformly sampled at a number 
10 of points. Light rays would be traced from every one of these points to every pixel in 
the CGH. The required transmission of each CGH pixel is calculated from the 
coherent addition of all these light rays. 

If the viewer's eye positions and pupil sizes are known then only those rays that could 
1 5 be extrapolated back to the eye pupils would need to be traced. This enables the 
number of rays that need to be traced to be reduced, thus saving computation time. 

If only the viewers eye positions are known, then some sensible value for the pupil 
size may be assumed e.g. a diameter of 4mm. Using a larger value for the pupil size 
20 in the CGH calculation will make the system more tolerant of eye position 
measurement errors although at the cost of increased computation time. 

A rule-of-thumb formula can be derived to estimate the computation savings 
expected: 

25 

If the eye is within the viewing region (29) it can be shown that all light rays from the 
three-dimensional image that reach the pupil either pass through the focal plane 
within the image volume or could be extrapolated back to it. Thus, to a good 
approximation, the maximum number of ray traces will be required for an image that 
30 consists of points filling the entire focal plane. 

It is very convenient to use this image as points in the focal plane of the replay optics 
arise from collimated beams from the CGH. Figure 3 illustrates this phenomenon. As 
before, light rays can be traced from the CGH (30), through the replay optics (31) to 
35 the viewer's eye pupil (33). Rays passing through the same point (34) in the focal 
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plane (32) can be shown to intersect the CGH at the same angle over a small area 
(36) of the CGH. Thus each point in the focal plane corresponds to a collimated beam 
(35) at a different angle in the region between the CGH and replay optics. The area 
on the CGH (and thus the number of CGH pixels within it) that contributes light at a 
5 particular angle is proportional to the area of the eye pupil and is independent of the 
distance of the CGH from the optics, although its position will vary. This area is 
approximately the same for all 'angles' of the light rays considered. Since the focal 
plane is completely filled it can be said that an area of the CGH equivalent to this area 
directs light into all these angles. 



Thus, using a CGH that is designed to direct light into all angles over its whole area 



and it is assumed that the pupil is approximately parallel to the lens. 

20 If a CGH based three-dimensionai display of a 50 x 50cm image with a field of view of 
±15°, pupil diameter 4mm andd = e = f =1m, then of order 10 4 times less traces will 
be needed. If the eye positions are only known approximately then the savings will be 
less although still useful. For example, where the eye positions are only known to be 
within a circular region 10cm in diameter at the above distance, then the reduction in 

.25 the number of traces would be around 30 times. 

Computation savings may also be achieved with other CGH design methods. For 
example, the diffraction specific method (M.Lucente, "Holographic bandwidth 
compression using spatial subsampling", Optical Engineering, Vol.35, No.6, June 
30 1996). In this case the bandwidth (range of spatial frequencies) of the fringes 

encoded into each hogel (holographic element) would be determined by the limited 
range of angles that each hogel is required to direct light into for a given viewer 
position. 



as a baseline, simple geometrical arguments show that the reduction, R , in the 
number of 'traces 1 is 
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Claims 

1 . Apparatus for producing a three-dimensional image comprising; 

5 a display means (1) capable of producing a three dimensional image (3) which is 
capable of being viewed from a range of viewing positions, 

a monitoring means (9)'for determining the viewing position of at least one observer, 

10 and control means (8) responsive to the monitoring means (9) for controlling the 
display means (1), 

wherein the display means (1) comprises a plurality of addressable sub-regions 
controlled by the control means (8) such that priority is given to producing a complete 
15 image for the at least one determined viewing position. 

2. The apparatus according to claim 1 wherein the viewing positions of two or more 
observers are determined and wherein priority is given to producing a complete 
image for each of the determined viewing positions. 

20 

3. The apparatus according to claim 1or 2 wherein the control means (8) identifies at 
least one contributing region, comprising addressable sub-regions of the display 
means (1), that contributes to the image formed for the at least one viewing position 
and wherein priority is given to calculating pixel values of the display means for said 

25 at least one contributing region. 

4. The apparatus according to claim 3 wherein the control means (8) gives priority to 
calculating pixel values for each of the sub-regions of the display means (1) that 
comprise substantially the centre of the at least one said contributing region. 

30 

5. The apparatus according to claim 3 and further comprising means for determining 
the position of ocular fixation (7) within the display means (1) of the at least one 
observer and wherein the control means (8) gives priority to calculating pixel values 
for each of the sub-regions of the display means (1) that contribute substantially to 

35 the image at the position of ocular fixation of the at least one observer. 
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6. The apparatus according to any of the preceding claims wherein the control 
means gives priority to calculating pixel values for each of the sub-regions of the 
display means (1) that correspond substantially to parts of the image that are 

5 changing. 

7. The apparatus according to any of the preceding claims wherein the control 
means (8) determines the range of angles that sub-regions of the display means (1) 
must direct light into to contribute to the image formed for the at least one viewing 

10 position and wherein priority is given to calculating pixel values of the display means 
such that light is substantially directed into said range of angles. 

8. The apparatus according to any of the preceding claims wherein the control 
means (8) controls the display means (1) such that the effective exit pupil of the 

1 5 apparatus is optimised for the at least one viewer, 

9. The apparatus according to any of the preceding claims wherein the effective exit 
pupil over which the complete image is viewable is enlarged during periods when the 
image is substantially unchanging. 

20 

10. The apparatus according to any of the preceding claims wherein the display 
means (1) comprises a spatial light modulator (SLM) means. 

11. The apparatus according to claim 10 wherein the control means (8) calculates the 
25 modulation required in the sub-regions of the spatial light modulator means. 

12. The apparatus according to any of the preceding claims wherein the monitoring 
means (9) collects information relating to the eyes of the at least one observer and 
wherein said information is used by the control means (8) to adapt the effective exit 

30 pupit of the apparatus to match the eyes of the at least one observer. 

13. The apparatus according to any of the preceding claims wherein the addressable 
sub-regions of the display means (1) display a computer generated hologram. 



35 
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14. A method of minimising the time required to display a reconfigurable three- 
dimensional image using 

5 a display means (1) comprising a plurality of addressable sub-regions, capable of 
producing a three dimensional image (3) which is capable of being viewed from a 
range of viewing positions, 

a monitoring means (9) for determining the viewing position of at least one observer, 

10 

and control means (8) responsive to the monitoring means (9) for controlling the 
display means (1), 

comprising the steps of determining the viewing position of the at least one observer 
15 and prioritising the control of the addressable sub-regions within the display means 
(1) to produce a complete image for the at least one determined viewing position. 

15. The method according to claim 14 wherein the viewing positions of two or more 
observers are determined and the control of the addressable sub-regions within the 

20 display means (1) prioritised to produce a complete image for the two or more 
determined viewing positions. 

16. The method according to claims 14 or 15 and further comprising the steps of 
identifying at least one contributing region, comprising addressable sub-regions of the 

25 display means (1), that contributes to the image formed for the at least one viewing 
position and giving priority to calculating pixel values for the sub-regions within the 
display means that comprise substantially the at least one said contributing region. 

17. The method according to claim 16 wherein priority is given to calculating pixel 
30 values for each of the sub-regions of the display means (1) that comprise 

substantially the centre of the at least one said contributing region. 
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18. The method according to claim 16 and further comprising the steps determining 
the position of ocular fixation (7) within the display means (1) of the at least one 
observer and giving priority to calculating pixel values for each of the sub-regions of 
the display means (1) that contribute substantially to the image at the position of 

5 ocular fixation of the at least one observer. 

19. The method according to claims 14-18 wherein priority is given to calculating pixel 
values for each of the sub-regions of the display means (1) that correspond 
substantially to parts of the image that are changing. 

10 

20. The method according to claims 14-19 and further comprising the steps of 
determining the range of angles that sub-regions of the display means (1) must direct 
light into to contribute substantially to the image formed for the at least one viewing 
position and calculating the pixel values of the display means such that priority is 

15 given to directing light into substantially said range of angles. 

21. The method according to claims 14-20 and further comprising the step of 
controlling the display means (1) such that the effective exit pupil of the apparatus is 
optimised for the at least one viewer. 

20 

22. The method according to claims 14-21 and further comprising the step of 
enlarging the effective exit pupil over which the complete image is viewable during 
periods when the image is substantially unchanging. 

25 23. The method according to claims 14-22 wherein the display means (1) comprises a 
spatial light modulator (SLM) means. 

24. The method according to claim 23 wherein the control means (8) calculates the 
modulation required in the sub-regions of the spatial light modulator means. 

30 

25. The method according to claims 14-24 wherein the monitoring means (9) collects 
information relating to the eyes of the at least one observer and wherein said 
information is used by the control means (8) to adapt the effective exit pupil of the 
apparatus to match the eyes of the at least one observer, 

35 
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26. The method according to claims 14-25 wherein the addressable sub-regions of 
the display means (1) display a computer generated hologram. 



> 
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